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METHOD AND APPARATUS FOR DETERMINING SYSTEM RESPONSE 

CHARACTERISTICS 

TECHNICAL FIELD 
The present invention relates to the determination of a response characteristic of 
an nth order linear system. More particularly, the present invention relates to 
determination of the response characteristic from a variance measured in the output signal 
of the linear system. 

BACKGROUND 

Nth order linear systems, such as phase locked loops (PLLs) and other electrical 
devices that can be approximated as behaving linearly, produce an output signal in 
response to receiving an input signal. The output signal has a variance at any point in 
time from an expected or mean output signal value. The output signal and its variation 
over time results from the interaction of the input signal, the transfer function of the 
linear system, and any noise processes that are present which may include periodic 
processes. Noise processes may originate externally or within the linear system and this 
noise degrades the performance of the linear system. 

When designing a linear system, the input signal, noise processes, and transfer 
function can be assumed for and/or estimated from simulations. However, when the 
linear system is to be constructed, for example, into an integrated circuit prototype, there 
is only access to the input and output signals. Details of the response including the noise 
processes and transfer function of this prototype cannot be directly measured. However, 
knowing the details of the response of the linear system prototype is important to confirm 
the design specification and simulation assumptions and to allow any design flaws and 
noise to be identified, fixed, and/or improved. 

A conventional method of finding response characteristics for a linear system has 
been to apply a fast Fourier transform (FFT) approach to obtain a response characteristic 
such as the power spectral density (PSD) from the output signal. This approach is limited 
in its application because the FFT approach requires uniform sampling of the input to the 
FFT which is the output signal of the system under test. Uniform sampling necessitates 
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increased recording and storage requirements and creates poor resolution for low 
frequencies. Furthermore, the FFT is known to be an inefficient narrowband approach 
when applied to broadband systems. 

Therefore, there is a need for additional methods that can determine response 
characteristics of an nth order linear system through access to the output signal. 

SUMMARY 

Embodiments of the present invention address the problems discussed above and 
others such as by measuring an output signal of the nth order linear system and 
constructing a variance record of a measurable quantity from the output signal. For 
example, jitter variance of a PLL may be measured as a function of time. A response 
characteristic of the linear system is then obtained from a mathematical relationship to 
the variance record. Alternatively, a PSD record may be obtained by various methods 
from the output signal, and the transfer function may be found by modeling an assumed 
response function to the PSD record to find transfer function parameters. 

The response characteristic may be obtained from the variance record through 
numerical or analytical means or by a combination. For example, the response 
characteristic, such as a PSD record, may be found from a direct numerical solution to an 
inhomogenous Fredholm integral of the first kind, see reference below, that has been 
adapted to relate the variance record to an unknown transfer function. A transfer function 
model may also be analytically fitted to the PSD to obtain the zeros and complex and real 
poles. 

Alternatively, a variance model that is a generic solution to the Fredholm integral 
may be fitted to the variance record to construct the response characteristic. By fitting 
the variance model to the variance record, parameters of the transfer function of the linear 
system, such as the damping factor and natural frequency of a second order linear system, 
may be found. From the transfer function parameters, the noise processes of the linear 
system may also be derived, such as by mathematical relationships between the transfer 
function and noise spectral density. The transfer function provides the zeros and complex 
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and real poles as well as other physical parameters of the linear system such as the 
impulse response and/or step response. 

Furthermore, by fitting a model mathematically related to the response function to 
the variance record or PSD record, an error estimate for the response characteristic being 
5 found may be generated. The fitting process provides a residue that results from the 
imperfections of the fit of the model. The total residue of imperfections can be used for 
relative comparisons to other attempts to attain the response characteristic, and thereby 
provide guidance as to accuracy. 



1 0 DESCRIPTION OF THE DRAWINGS 

FIG. 0 is a diagram illustrating the main process flow and alternative approaches 
of embodiments of the present invention. 

FIG. 1 is an exemplary system employed by the process flow of FIG. 0 for 
determining the response characteristic of an nth order linear system. 
1 5 FIG. 2 is an exemplary operational flow showing the alternative operations that 

may be utilized by the system of FIG. 1. 

FIG. 3 is an exemplary operational flow showing the alternative operations of the 
model determination and fitting procedure of FIG. 2. 

FIG. 4. is an exemplary graph of a Bode plot showing the poles and zeros of the 
20 transfer function determined for a linear system, such as a PLL, that is generated by the 
operational flow of FIG. 2. 

FIG. 5 is an exemplary impulse response for the nth order linear system that may 
be determined by the operational flow of FIG. 2 after the transfer function has been 
found. 

25 FIG. 6 is a diagram illustrating the application of the transfer function modeling 

the nth order system to predict an input or output signal magnitude. 

DETAILED DESCRIPTION 
Various embodiments of the present invention will be described in detail with 
30 reference to the drawings, wherein like reference numerals represent like parts and 
assemblies throughout the several views. Reference to various embodiments does not 
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limit the scope of the present invention, which is limited only by the scope of the claims 
attached hereto. 

FIG. 0 is an exemplary process flow for rinding a response characteristic such as 
the transfer function of a linear system in accordance with embodiments of the present 
invention. The details of the individual portions of the process flow are discussed in 
greater detail with reference to the remaining figures. A noise source 50 provides an 
input signal to the nth order linear system 52 that is under test. The input signal may 
contain noise, multiple Fourier series, and/or any arbitrary periodic. The system 52 under 
test produces an output signal that contains measurable quantities that vary from a mean 
value for the output signal, and this difference from the mean for the various samples of 
the measurable quantity establishes variance data 54. The variance data measured with 
respect to time or space is maintained as a variance record. 

A variance procedure 56 may then be applied to the variance record to find 
parameters for the transfer function of the nth order linear system and/or PSD. The 
variance record is equal to an equation, or variance model, whose unknowns are also the 
unknown parameters of the transfer function whose basic form is generally known for the 
nth order linear system. The variance procedure 56 may involve analytically fitting a 
variance model based on an assumed generic transfer function form, or may involve 
assuming a transfer function form and pole-zero placement, solving an integral 
relationship between the transfer function and variance record and repeating until the 
integral solution most closely fits the actual variance record. Once the transfer function 
parameters describing the response are found, transfer function data 58 may be displayed 
such as in the form of a pole-zero plot, an impulse response, a step response, etc. 

As an alternative to using the variance procedure with the variance data 54, the 
variance data 54 may be converted to a power spectrum density (PSD) record 60 through 
a numerical solution involving multiple filter banks, discussed below. The PSD record 
60 may also come more directly from the system under test 52. After the PSD record 60 
is found, a PSD procedure 62 is used to model the transfer function by fitting a pole-zero 
function to the PSD record 60. The transfer function data 58 is then available as it was 
when produced by the variance procedure 56. 
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FIG. 1 is an exemplary illustration of a representative hardware environment for a 
signal analyzing system 100 according to an exemplary embodiment of the present 
invention. A typical configuration may include a measurement apparatus 102 that 
measures the time interval between two events (start and stop) through counters. A 
5 measurement apparatus is disclosed in United States Patent No. 4,908,784, which is 
hereby incorporated by reference. A typical measurement apparatus is the Wavecrest 
DTS-2075, available from Wavecrest Corporation, Edina, MN. 

Those skilled in the art will recognize that other systems that enable signal 
analysis that are based on real world measurement (i.e., measurements that are non-ideal 

10 or subject to uncertainty) would be applicable. These devices include an oscilloscope, 
Automated Test Equipment (ATE), spectrum analyzer, network analyzer, TIA (time 
interval analyzer), universal time frequency counter, and modulation domain analyzer. 

The measurement apparatus 102 interfaces to a workstation 104 and operates 
under the control of an analysis program 106 resident on the workstation 104. The 

1 5 analysis program 106 is typically implemented through data analysis software. One 
commercially available analysis software is the Wavecrest Virtual Instrument Signal 
Integrity (VISI) software, available from Wavecrest Corporation, Edina, MN. Other 
analysis software includes LAB VIEW, MathCad, MATLAB, and Mathematica, among 
others. The workstation 104 comprises a processor 108 and a memory including random 

20 access memory (RAM), read only memory (ROM), and/or other components. The 

workstation 104 operates under control of an operating system, such as the UNIX® or the 
Microsoft® Windows NT operating system, stored in the memory to present data to the 
user on the output device 110 and to accept and process commands from the user via 
input device 112, such as a keyboard or mouse. 

25 The analysis program 106 of the present invention is preferably implemented 

using one or more computer programs or applications executed by the workstation 104. 
Those skilled in the art will recognize that the functionality of the workstation 104 may 
be implemented in alternate hardware arrangements, including a configuration where the 
measurement apparatus 102 includes CPU 118, memory, and I/O capable of 

30 implementing some or all of the steps performed by the analysis program 106. Generally, 
the operating system and the computer programs implementing the present invention are 
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tangibly embodied in a computer-readable medium, e.g. one or more data storage devices 
1 14, such as a zip drive, floppy disc drive, hard drive, CD-ROM drive, firmware, or tape 
drive. However, such programs may also reside on a remote server, personal computer, 
or other computer device. 
5 The analysis program 1 06 provides for different measurement/ analysis options 

and measurement sequences. The analysis program 106 interacts with the measurement 
apparatus 102 through the on-board CPU 118. In one embodiment, the measurement 
apparatus 102 provides arming/enabling functionality such that the apparatus 102 can 
measure a signal either synchronously or asynchronously. The output signal of the nth 
10 order linear system is fed to a channel input 120. The multiplexer/event counter 134 is 
triggered on the clock edges received through the input 120 and provides an indication of 
the triggers to counter/interpolators 128, 130, and 132. The counter/interpolators 128, 
? 1 30, and 1 32 are driven by an on-board clock 1 36 and measure the time elapse between 

yj the start and stop events. The counter 130 provides a coarse measurement while the 

1 1 15 interpolators 128, 132 provide fine time resolution down to 0.8 ps. The clock 136 is 
' f ""Z. typically a precise crystal oscillator. 

y Those skilled in the art will recognize that the exemplary environment illustrated 

l k in FIG. 1 is not intended to limit the present invention. Indeed, those skilled in the art 

will recognize that other alternative hardware environments may be used without 
||l 20 departing from the scope of the present invention. 

f f As shown, in FIG. 2, the operational flow of the signal analyzing system 100 

begins at variance record operation 202. Here, the measurement apparatus 102 makes 
measurements of a measurable quantity from the output signal of the system being tested. 
For example, the jitter of the output may be measured on a per edge basis as a function of 
25 time, or voltage of the output may be measured as a function of time. Other quantities 
varying in time or space may be measured and used as well. The workstation 104 
receives the measurement of the measurable quantity and constructs a variance record 
estimating the variance based on the measurements. The measured variance record 
VAR measure d(T) for magnitude (MAG) measurements is shown in equation (1) where 
30 MAG& (t) is the difference in magnitude for two measurements forming a sample pair 
taken from the output signal where the measurements are separated by t in time or space, 
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MAG a (t) represents the mean of the MAG ih (Y) values and Lmax is the total number 
of MAG iA (r) values. 



£max 

VAR (t) = — ! — V 

' yxI1 measured V 1, ) Xmax-l / ; 



MAG i& (t) - MAG a (t) 



(1) 



Non-uniform sampling schedules, i.e. logarithmic, etc., may be used to generate 
the variance record including sampling schedules that are arbitrary. After the variance 

10 record has been generated, the workstation 104 may take one of two different basic 

approaches, proceed based on the variance record or convert to a PSD record and proceed 
with the PSD record. In the variance record approach, at variance model operation 204 
and fitting operation 206, the workstation 104 can take a generic response function 
approach to finding the transfer function parameters or a specific assumed response 

15 function approach. These two approaches are shown in FIG. 3 and are discussed in more 
detail below. 

For either approach, a simplification of VAR mo dei (t) is possible because the noise 
PSD at the output is equal to the noise PSD at the input multiplied by the square of the 
transfer function's absolute value and because VAR mo d e i(x) is equal to VAR mo dei (0) minus 
20 the inverse Fourier transform of the output PSD. The PSD may be estimated as described 
in U.S. Patent No. 6,185,509 which is hereby incorporated by reference. Thus, VAR mo d e i 
(t) can be simplified into equation (2) which is an inhomogenous Fredholm integral of 
the first kind. See Press et al., Numerical Recipes in C: The Art of Scientific Computing, 
2d ed, p. 788, Cambridge University Press, 1992. 

25 

VAR mM (r)= J [F(a>,r) ] [H(jco) ] 2 [S input (o>)]do (2) 

[F(oo, t)] may be expressed as 1 - cos (© x), or may take various other forms 
including a sin 2 expression, an exponential expression, or a power series. The variance 



7 



Attorney Docket No. 12583.19US01 



record VAR me asured (x) is a function of both the transfer function HQ©) and input noise 
spectral density [S inpu t(co)]of the nth order linear system being tested. When white noise 
is used as the input signal, the Fredholm integral of equation (2) may be simplified by 
removing the [S inp ut(co)] component as the spectral density of white noise reduces to a 
5 constant that is absorbed into H(jco). 

Using the generic response function approach, which begins at variance model 
operation 222, the workstation 104 finds a variance model VAR mo dei(x) that is to be fit to 
the variance data record VAR me asured(x) previously created. Fitting VAR mo dei(T) requires 
finding a variance function that closely matches VAR mea sured(x). Finding VAR m0 dei (x) for 

10 VAR meaS ured(x) can be done at variance model operation 222 by solving equation (2) with 
[Si„put(co)] removed due to application of white noise at the input. Other input signals 
may be used as well where the PSD for the input signals is known. In the example where 
white noise is used, an analytical solution to equation (2) involves using a generic (i.e., 
unknown zero and pole values) transfer function H(jco) known for the particular linear 

1 5 system being tested in equation (2) and finding a generic solution. 

Once VAR m0 dei (x) has been obtained, it is fit to VAR meaS ured(x) at fitting operation 
224. Fitting operation 224 involves manipulating the transfer function parameters that 
are present in the VAR mo dei (x) function using a least squared or chi squared fitting 
procedure to minimize the difference between VAR mo dei (x) and VAR meaS ured(x). Once the 

20 VAR m odei (x) function has been manipulated to minimize the difference, the transfer 
function parameters are extracted form VAR mo dei (x) and can be subsequently used as 
discussed below to analyze the system under test. 

The discussion included below in relation to operations 222 and 224 specifically 
references a second order system but only for exemplary purposes. One skilled in the art 

25 will realize that the embodiments of the present invention are applicable to systems of 
other orders. Using a second order system as an example is useful due to second order 
systems providing a rough approximation for higher order systems. Equation (3) is a 
generic transfer function for a PLL example approximated by a second order linear 
system. Equation (4) is a generic solution to equation (2) for the underdamped case of 

30 the PLL, equation (5) is a generic solution to equation (2) for the overdamped case of the 
PLL, and equation (6) is a generic solution to equation (2) for the neutral case of the PLL. 
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Equations (4), (5), and (6) are derived at model operation 222 from equation (2) with coi 0 
equal to zero and com equal to infinity. 



#0) = , — 2 



5 2 + 2#» JI J + 0 J| 

(3) 



2^ 2 -1 I C2 Cl 



where^>l,c 1 = [(2^ 2 -l)-2^V?^] 1/ %^ = [(2^ 2 -l) + 2^V? 7: ^] 1/ %and C 3 = ^. 
10 (4) 



VA n (r) { L/lT^« + 1) + AC ~ $ ] I - e- (a -' ■ zos{fiTf w„t) ) - [jl^W 2 + 1) + <T " 4f 3 K*' smcVw^.r) } } 

where < 1 . 

15 (5) 



VAR^{^-^-\5 + $c> n T-S)e°>* ] where £ = 1. 

(6) 

20 

In the generic transfer function of equation (3) for the second order linear system 
and generic solutions of equations (4), (5), and (6), the unknown parameter £ is the 
damping factor of the second order linear system and the unknown parameter co n is the 
natural frequency. Using a least squared fit, chi squared fit, or other fitting method 
25 known in the art at fitting operation 224, these unknown parameters in the generic 

solution of equation (4), (5), or (6), depending upon the damping of the linear system 
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being tested, are manipulated until a satisfactory fit is achieved. A satisfactory fit is one 
that has generally minimized the difference in each value of VAR mo dei 0) and 
VAR me asuredO) for eacn of tne values of the variance record. The resulting values for 
these parameters, ©„ and in the appropriate generic solution to equation (2) are also the 
5 values for the unknowns of the transfer function H(j ©) of the second order linear system 
being tested. 

If the damping characteristics of the system under test are unknown, then 
equations for all three cases may be used and the variance model that best fits the 
variance record of the system will be adequate to use when extracting the transfer 

1 0 function parameters . 

Once the variance model has been properly fitted to the variance record by 
finding the proper value for co n and C, for the second order linear system, operational flow 
transitions to error estimate operation 208 of FIG. 2. Subsequently, the response 
characteristic is found by establishing the transfer function H(jco) of the nth order linear 

1 5 system through plugging the co n and £ parameters into the generic transfer function known 
for the linear system. The transfer function now indicates the poles and zeros of the 
linear system. 

Another approach involving the variance record directly is shown in FIG. 3. 

Rather than finding a generic variance model solution that can be fit to the variance 
20 record, a pole-zero response function may be assumed having particular pole-zero 

locations. The mathematical expression of equation (2) may then be solved for all values 

of t to find a derived variance record model at model operation 226 which is compared to 

the constructed variance record taken from the output signal of the system under test. 

Then, the derived variance record model may be fit to the variance record at fitting 
25 operation 206 by pole-zero operation 228 altering the pole-zero locations of the pole-zero 

response function previously assumed. 

After altering the pole-zero locations, a new derived variance record model is 

found at integration operation 230 by again solving the Fredholm integral of equation (2). 

Query operation 234 tests whether the derived variance record model is satisfactory based 
30 on the residue of imperfection between the derived variance record model and the 

constructed variance record model. It is desirable to minimize the residue to provide the 
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best fit. Once a satisfactory derived variance record model has been found, the pole-zero 
locations of the response function used to produce the variance record are taken as the 
pole-zero locations of the response function for the system under test. Operational flow 
then proceeds to error estimate operation 208 of FIG. 2. 
5 Regardless of the approach taken for using the variance record to obtain the 

response characteristic, such as the pole-zero locations of the transfer function, it is 
desirable to know the accuracy of the assumptions, such as the assumption of the number 
of poles an zeros of the system under test. Furthermore, it is desirable to know the 
accuracy of the positioning of the poles and zeros that result from the fitting procedure. 

10 Therefore, an error estimate may be generated at error estimate operation 208 by 

accumulating the residue, or imperfection of the fitting procedure. This error estimate 
may be used as a basis for comparison to other attempts to obtain the transfer function 
parameters, and it is desirable to find the transfer function parameters that produces the 
smallest error estimate. 

15 As an alternative to the direct variance record approach of variance model 

operation 204 and fitting operation 206, an embodiment of the operational flow may 
involve finding a PSD record from the variance record at PSD operation 214. The PSD 
record results from a numerical solution to the mathematical relationship between the 
variance record and the transfer function. One example of a direct numerical solution 

20 involves a piecewise approach whereby [H(jco)] 2 is split into a PSD estimate E(co m ) 
multiplied by a generically chosen filter bank [H F Bm(a>)] 2 . The filter bank may be 
selected to have bandpass filters each with a different center frequency, with each 
filter of the filter bank being chosen as an integrateable function over a specific band 
between co M io to comm when multiplied with [F(co, tl)]. The center frequencies of the filter 

25 bank are spread across the band of coi 0 to ©hi. E(co m ) is assumed to be a constant across 
corresponding integration limits and is therefore removed from the integral of equation 
(2). The result is shown below as equation (7), which is solved for all values of L up to 
Lmax discussed in relation to equation (1). 



M max 



30 VAR_ ed (r L )= X E{a> M ) J [F(co,t l ) ] [H FBm (jco) ] 2 dco (7) 



M=l 
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The limits of integration, © M io to co M hi , change as each filter changes across the 
band of ©i 0 to G) hi . Equation (7) can be simplified using a set of coefficients A M l for all 
5 values M and L up to Mmax and Lmax, respectively, as shown in equation (8). 

M max <°M, 

VAR measured {r L )= £ E{6> M )A m , where A m = J [F(co,t l ) ] [H FBm (jco) J dco 

(8) 



A matrix of simultaneous equations relating A L mEm to VAR(x L ) can be 
1 0 configured according to equation (8). This matrix of simultaneous equations is shown as 
equation set (9). E(co M ) is expressed as E M in equation (9) since each instance E M is 
assumed to be constant. The variables E M of equation (9) are the only unknown values. 



A n E, +A n E 2 + AMmaAmax = VARfa) 

A n E, +A 22 E 2 + Am maxima* =VAR(t 2 ) 



^Xmaxl-^1 + At max 2-^2 + A. max M max ^ U max -^( T imax) 

15 (9) 



The set of values E M found from solving the matrix established by the equation 
set (9), provides a response characteristic, which is the PSD record, for the nth order 
linear system. The transfer function H(jco) can be found by assuming a model pole-zero 

20 function for PSD, such as based on equation (2) for a second order system, in PSD model 
operation 216. The pole-zero function is analytically fit to the PSD record using a least 
squared or chi squared fit to manipulate the pole-zero locations at fitting operation 218. 
A least squared fit or chi squared fit minimizes the difference between the pole-zero 
function and the PSD record to obtain the pole-zero locations of the transfer function. 

25 The poles and zeros are then known for the transfer function. 
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Again, it is desirable to know the accuracy of the assumed pole-zero function, 
which is an assumption of the number of poles an zeros of the system under test. 
Furthermore, it is desirable to know the accuracy of the positioning of the poles and zeros 
that result from the fitting procedure. Therefore, an error estimate may be generated at 
error estimate operation 220 by accumulating the residue, or imperfection of the fitting 
procedure. This error estimate may be used as a basis for comparison to other attempts to 
obtain the transfer function parameters, and it is desirable to find the pole-zero model that 
produces the smallest error estimate. 

After a determination of the transfer function H(j©) for the nth order linear system 
as discussed above using the variance procedure of operations 204 through 206 or the 
PSD operations 214 through 216, operational parameters for the linear system may be 
derived from the transfer function H(jco) and the noise processes may be found at 
derivation operation 210. For the PLL example, operational parameters including but not 
limited to pull-in time, pull-out range, lock-in time, and lock-in range may be found at 
derivation operation 210 through ordinary computations known in the art. Additionally, 
noise processes of the linear system may be found including the noise bandwidth through 
known computations based on the transfer function parameters. As discussed below, 
noise processes including input and/or output noise PSD may also be determined from 
the transfer function. 

Other information may also be obtained from the transfer function H(jo), such as 
the time domain function resulting from an inverse Laplacian transformation, the impulse 
response, the step response, the ramp response, and others. Once the noise processes, 
operational parameters, and additional responses have been determined in addition to the 
transfer function H(jco), the response of the nth order linear system including the transfer 
function H(jco) may be graphed, such as in a Bode plot or root locus plot at display 
operation 212, and may be provided through an output of the testing equipment. 
Furthermore, the poles and zeros of the nth order linear system are known from the 
transfer function H(ja>) and will appear in the graph. FIG. 4 shows exemplary Bode plots 
for the PLL example containing the amplitude and phase as a function of frequency and 
FIG. 5 shows an exemplary impulse response. 
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FIG. 6 shows the application of the transfer function H(jco) that has been 
determined by the logical operations of FIG. 2. The linear system that has been tested 
can be expressed as a model 500 defined by the transfer function H(jco). If an input 
signal is known, the output magnitude can be determined through convolution in the time 
5 or space domain of the input magnitude and the transfer function H(jco), or by 

multiplication in the frequency domain. Likewise, if an output signal magnitude is 
known, the input magnitude that was provided to the linear system can be determined 
through deconvolution in the time or space domain of the output signal and the transfer 
function H(jco), or by division in the frequency domain. 

10 Similarly, noise processes may be determined from the relationship between input 

noise PSD [Si npu t(o))] and output noise spectral density [S out put(o))]. The PSD for input 
noise is equal to the output noise spectral density multiplied by the magnitude of the 
transfer function squared in the frequency domain. The input noise source may be 
modeled as an nth order linear system through the process described above by creating a 

1 5 variance record directly from the noise source output being used as an input signal to the 
system under test. The input noise PSD record can then be determined as discussed 
above. 

One skilled in the art will recognize that the analytical and numerical methods 
discussed above for finding a response characteristic from the variance record are 
20 exemplary only. Other methods are equally applicable, including approaches such as 
wavelet theory for relating the variance measured in the output signal to a response 
characteristic. 

While the invention has been particularly shown and described with reference to 
preferred embodiments thereof, it will be understood by those skilled in the art that 
25 various other changes in the form and details may be made therein without departing 
from the spirit and scope of the invention. 



14 



